An automatic pipeline for atlas-based fetal and neonatal brain segmentation and analysis.

BACKGROUND AND OBJECTIVE: The automatic segmentation of perinatal brain structures in magnetic resonance imaging (MRI) is of utmost importance for the study of brain growth and related complications. While different methods exist for adult and pediatric MRI data, there is a lack for automatic tools for the analysis of perinatal imaging. METHODS: In this work, a new pipeline for fetal and neonatal segmentation has been developed. We also report the creation of two new fetal atlases, and their use within the pipeline for atlas-based segmentation, based on novel registration methods. The pipeline is also able to extract cortical and pial surfaces and compute features, such as curvature, local gyrification index, sulcal depth, and thickness. RESULTS: Results show that the introduction of the new templates together with our segmentation strategy leads to accurate results when compared to expert annotations, as well as better performances when compared to a reference pipeline (developing Human Connectome Project (dHCP)), for both early and late-onset fetal brains. CONCLUSIONS: These findings show the potential of the presented atlases and the whole pipeline for application in both fetal, neonatal, and longitudinal studies, which could lead to dramatic improvements in the understanding of perinatal brain development.

Fetal Liver Volume Assessment Using Magnetic Resonance Imaging in Fetuses With Cytomegalovirus Infection†.

Objective: To assess fetal liver volume (FLV) by magnetic resonance imaging (MRI) in cytomegalovirus (CMV)-infected fetuses compared to a group of healthy fetuses. Method: Most infected cases were diagnosed by the evidence of ultrasound abnormalities during routine scans and in some after maternal CMV screening. CMV-infected fetuses were considered severely or mildly affected according to prenatal brain lesions identified by ultrasound (US)/MRI. We assessed FLV, the FLV to abdominal circumference (AC) ratio (FLV/AC-ratio), and the FLV to fetal body volume (FBV) ratio (FLV/FBV-ratio). As controls, we included 33 healthy fetuses. Hepatomegaly was evaluated post-mortem in 11 cases of congenital CMV infection. Parametric trend and intraclass correlation analyses were performed. Results: There were no significant differences in FLV between infected (n = 32) and healthy fetuses. On correcting the FLV for AC and FBV, we observed a significantly higher FLV in CMV-infected fetuses. There were no significant differences in the FLV, or the FLV/AC or FLV/FBV-ratios according to the severity of brain abnormalities. There was excellent concordance between the fetal liver weight estimated by MRI and liver weight obtained post-mortem. Hepatomegaly was not detected in any CMV-infected fetus. Conclusion: In CMV-infected fetuses, FLV corrected for AC and FBV was higher compared to healthy controls, indicating relative hepatomegaly. These parameters could potentially be used as surrogate markers of liver enlargement.

A novel approach to multiple anatomical shape analysis: Application to fetal ventriculomegaly.

Fetal ventriculomegaly (VM) is a condition in which one or both lateral ventricles are enlarged, and is diagnosed as an atrial diameter larger than 10 mm. Evidence of altered cortical folding associated with VM has been shown in the literature. However, existing works use a single scalar value such as diagnosis or lateral ventricular volume to characterize VM and study its relationship with alterations in cortical folding, thus failing to reveal the spatially-heterogeneous associations. In this work, we propose a novel approach to identify fine-grained associations between cortical folding and ventricular enlargement by leveraging the vertex-wise correlations between their growth patterns in terms of area expansion and curvature. Our approach comprises three steps. In the first step, we define a joint graph Laplacian matrix using cortex-to-ventricle correlations. The joint Laplacian is built based on multiple cortical features. Next, we propose a spectral embedding of the cortex-to-ventricle graph into a common underlying space where its nodes are projected according to the joint ventricle-cortex growth patterns. In this low-dimensional joint ventricle-cortex space, associated growth patterns lie close to each other. In the final step, we perform hierarchical clustering in the joint embedded space to identify associated sub-regions between cortex and ventricle. Using a dataset of 25 healthy fetuses and 23 fetuses with isolated non-severe VM within the age range of 26-29 gestational weeks, our approach reveals clinically relevant and heterogeneous regional associations. Cortical regions forming these associations are further validated using statistical analysis, revealing regions with altered folding that are significantly associated with ventricular dilation.

Fetal cortical surface atlas parcellation based on growth patterns.

Defining anatomically and functionally meaningful parcellation maps on cortical surface atlases is of great importance in surface-based neuroimaging analysis. The conventional cortical parcellation maps are typically defined based on anatomical cortical folding landmarks in adult surface atlases. However, they are not suitable for fetal brain studies, due to dramatic differences in brain size, shape, and properties between adults and fetuses. To address this issue, we propose a novel data-driven method for parcellation of fetal cortical surface atlases into distinct regions based on the dynamic "growth patterns" of cortical properties (e.g., surface area) from a population of fetuses. Our motivation is that the growth patterns of cortical properties indicate the underlying rapid changes of microstructures, which determine the molecular and functional principles of the cortex. Thus, growth patterns are well suitable for defining distinct cortical regions in development, structure, and function. To comprehensively capture the similarities of cortical growth patterns among vertices, we construct two complementary similarity matrices. One is directly based on the growth trajectories of vertices, and the other is based on the correlation profiles of vertices' growth trajectories in relation to a set of reference points. Then, we nonlinearly fuse these two similarity matrices into a single one, which can better capture both their common and complementary information than by simply averaging them. Finally, based on this fused similarity matrix, we perform spectral clustering to divide the fetal cortical surface atlases into distinct regions. By applying our method on 25 normal fetuses from 26 to 29 gestational weeks, we construct age-specific fetal cortical surface atlases equipped with biologically meaningful parcellation maps based on cortical growth patterns. Importantly, our generated parcellation maps reveal spatially contiguous, hierarchical and bilaterally relatively symmetric patterns of fetal cortical surface development.

Patch spaces and fusion strategies in patch-based label fusion.

In the field of multi-atlas segmentation, patch-based approaches have shown promising results in the segmentation of biomedical images. In the most common approach, registration is used to warp the atlases to the target space and then the warped atlas labelmaps are fused into a consensus segmentation based on local appearance information encoded in form of patches. The registration step establishes spatial correspondence, which is important to obtain anatomical priors. Patch-based label fusion in the target space has shown to produce very accurate segmentations although at the expense of registering all atlases to each target image. Moreover, appearance (i.e., patches) and label information used by label fusion is extracted from the warped atlases, which are subject to interpolation errors. In this work, we revisit and extend the patch-based label fusion framework, exploring the role of extracting this information from the native space of both atlases and target images, thus avoiding interpolation artifacts, but at the same time, we do it in a way that it does not sacrifice the anatomical priors derived by registration. We further propose a common formulation for two widely-used label fusion strategies, i.e., similarity-based and a particular type of learning-based label fusion. The proposed framework is evaluated on subcortical structure segmentation in adult brains and tissue segmentation in fetal brain MRI. Our results indicate that using atlas patches in their native space yields superior performance than warping the atlases to the target image. The learning-based approach tends to outperform the similarity-based approach, with the particularity that using patches in native space lessens the computational requirements of learning. As conclusion, the combination of learning-based label fusion and native atlas patches yields the best performance with reduced test times than conventional similarity-based approaches.

FETAL CORTICAL PARCELLATION BASED ON GROWTH PATTERNS.

Dividing the human cerebral cortex into structurally and functionally distinct regions is important in many neuroimaging studies. Although many parcellations have been created for adults, they are not applicable for fetal studies, due to dramatic differences in brain size, shape and folding between adults and fetuses, as well as dynamic growth of fetal brains. To address this issue, we propose a novel method to divide a population of fetal cortical surfaces into distinct regions based on the dynamic growth patterns of cortical properties, which indicate the underlying changes of microstructures. As microstructures determine the molecular organization and functional principles of the cortex, growth patterns enable an accurate definition of distinct regions in development, microstructure, and function. To comprehensively capture the similarities of cortical growth patterns among vertices, we construct two complementary similarity matrices. One is directly based on the growth trajectories of vertices and the other is based on the correlation profiles of vertices' growth trajectories in relation to those of reference points. Then, we nonlinearly fuse these two similarity matrices into a single one, which can better captures both their common and complementary information than by simply averaging them. Finally, based on this fused matrix, we perform spectral clustering to divide fetal cortical surfaces into distinct regions. We have applied our method on 25 normal fetuses from 26 to 29 gestational weeks and generated biologically meaningful parcellations.

Learning to combine complementary segmentation methods for fetal and 6-month infant brain MRI segmentation.

Segmentation of brain structures during the pre-natal and early post-natal periods is the first step for subsequent analysis of brain development. Segmentation techniques can be roughly divided into two families. The first, which we denote as registration-based techniques, rely on initial estimates derived by registration to one (or several) templates. The second family, denoted as learning-based techniques, relate imaging (and spatial) features to their corresponding anatomical labels. Each approach has its own qualities and both are complementary to each other. In this paper, we explore two ensembling strategies, namely, stacking and cascading to combine the strengths of both families. We present experiments on segmentation of 6-month infant brains and a cohort of fetuses with isolated non-severe ventriculomegaly (INSVM). INSVM is diagnosed when ventricles are mildly enlarged and no other anomalies are apparent. Prognosis is difficult based solely on the degree of ventricular enlargement. In order to find markers for a more reliable prognosis, we use the resulting segmentations to find abnormalities in the cortical folding of INSVM fetuses. Segmentation results show that either combination strategy outperform all of the individual methods, thus demonstrating the capability of learning systematic combinations that lead to an overall improvement. In particular, the cascading strategy outperforms the ensembling one, the former one obtaining top 5, 7 and 13 results (out of 21 teams) in the segmentation of white matter, gray matter and cerebro-spinal fluid in the iSeg2017 MICCAI Segmentation Challenge. The resulting segmentations reveal that INSVM fetuses have a less convoluted cortex. This points to cortical folding abnormalities as potential markers of later neurodevelopmental outcomes.

Cortical folding alterations in fetuses with isolated non-severe ventriculomegaly.

Neuroimaging of brain diseases plays a crucial role in understanding brain abnormalities and early diagnosis. Of great importance is the study of brain abnormalities in utero and the assessment of deviations in case of maldevelopment. In this work, brain magnetic resonance images from 23 isolated non-severe ventriculomegaly (INSVM) fetuses and 25 healthy controls between 26 and 29 gestational weeks were used to identify INSVM-related cortical folding deviations from normative development. Since these alterations may reflect abnormal neurodevelopment, our working hypothesis is that markers of cortical folding can provide cues to improve the prediction of later neurodevelopmental problems in INSVM subjects. We analyzed the relationship of ventricular enlargement with cortical folding alterations in a regional basis using several curvature-based measures describing the folding of each cortical region. Statistical analysis (global and hemispheric) and sparse linear regression approaches were then used to find the cortical regions whose folding is associated with ventricular dilation. Results from both approaches were in great accordance, showing a significant cortical folding decrease in the insula, posterior part of the temporal lobe and occipital lobe. Moreover, compared to the global analysis, stronger ipsilateral associations of ventricular enlargement with reduced cortical folding were encountered by the hemispheric analysis. Our findings confirm and extend previous studies by identifying various cortical regions and emphasizing ipsilateral effects of ventricular enlargement in altered folding. This suggests that INSVM is an indicator of altered cortical development, and moreover, cortical regions with reduced folding constitute potential prognostic biomarkers to be used in follow-up studies to decipher the outcome of INSVM fetuses.

Altered cortical development in fetuses with isolated nonsevere ventriculomegaly assessed by neurosonography.

OBJECTIVES: To perform a comprehensive assessment of cortical development in fetuses with isolated nonsevere ventriculomegaly (INSVM) by neurosonography. METHODS: We prospectively included 40 fetuses with INSVM and 40 controls. INSVM was defined as atrial width between 10.0 and 14.9 mm without associated malformation, infection, or chromosomal abnormality. Cortical development was assessed by neurosonography at 26 and 30 weeks of gestation measuring depth of selected sulci and applying a maturation scale from 0 (no appearance) to 5 (maximally developed) of main sulci and areas. RESULTS: INSVM showed underdeveloped calcarine and parieto-occipital sulci. In addition, significant delayed maturation pattern was also observed in regions distant to ventricular system including Insula depth (controls 30.8 mm [SD 1.7] vs INSVM 31.7 mm [1.8]; P = .04), Sylvian fissure grading (>2 at 26 weeks: controls 87.5% vs INSVM 50%, P = .01), mesial area grading (>2 at 30 weeks: controls 95% vs INSVM 62.5%; P = .03), and cingulate sulcus grading (>2 at 30 weeks: controls 100% vs INSVM 80.5%; P = .01). CONCLUSIONS: Fetuses with INSVM showed underdeveloped cortical maturation including also regions, where effect of ventricular dilatation is unlikely. These results suggest that in a proportion of fetuses with INSVM, ventricular dilation might be related with altered cortical architecture.

Revealing Regional Associations of Cortical Folding Alterations with In Utero Ventricular Dilation Using Joint Spectral Embedding.

Fetal ventriculomegaly (VM) is a condition with dilation of one or both lateral ventricles, and is diagnosed as an atrial diameter larger than 10 mm. Evidence of altered cortical folding associated with VM has been shown in the literature. However, existing studies use a holistic approach (i.e., ventricle as a whole) based on diagnosis or ventricular volume, thus failing to reveal the spatially-heterogeneous association patterns between cortex and ventricle. To address this issue, we develop a novel method to identify spatially fine-scaled association maps between cortical development and VM by leveraging vertex-wise correlations between the growth patterns of both ventricular and cortical surfaces in terms of area expansion and curvature information. Our approach comprises multiple steps. In the first step, we define a joint graph Laplacian matrix using cortex-to-ventricle correlations. Next, we propose a spectral embedding of the cortex-to-ventricle graph into a common underlying space where their joint growth patterns are projected. More importantly, in the joint ventricle-cortex space, the vertices of associated regions from both cortical and ventricular surfaces would lie close to each other. In the final step, we perform clustering in the joint embedded space to identify associated sub-regions between cortex and ventricle. Using a dataset of 25 healthy fetuses and 23 fetuses with isolated non-severe VM within the age range of 26-29 gestational weeks, our results show that the proposed approach is able to reveal clinically relevant and meaningful regional associations.

Learning and combining image neighborhoods using random forests for neonatal brain disease classification.

It is challenging to characterize and classify normal and abnormal brain development during early childhood. To reduce the complexity of heterogeneous data population, manifold learning techniques are increasingly applied, which find a low-dimensional representation of the data, while preserving all relevant information. The neighborhood definition used for constructing manifold representations of the population is crucial for preserving the similarity structure and it is highly application dependent. The recently proposed neighborhood approximation forests learn a neighborhood structure in a dataset based on a user-defined distance. We propose a framework to learn multiple pairwise distances in a population of brain images and to combine them in an unsupervised manner optimally in a manifold learning step. Unlike other methods that only use a univariate distance measure, our method allows for a natural combination of multiple distances from heterogeneous sources. As a result, it yields a representation of the population that preserves the multiple distances. Furthermore, our method also selects the most predictive features associated with the distances. We evaluate our method in neonatal magnetic resonance images of three groups (term controls, patients affected by intrauterine growth restriction and mild isolated ventriculomegaly). We show that combining multiple distances related to the condition improves the overall characterization and classification of the three clinical groups compared to the use of single distances and classical unsupervised manifold learning.

Toward the automatic quantification of in utero brain development in 3D structural MRI: A review.

Investigating the human brain in utero is important for researchers and clinicians seeking to understand early neurodevelopmental processes. With the advent of fast magnetic resonance imaging (MRI) techniques and the development of motion correction algorithms to obtain high-quality 3D images of the fetal brain, it is now possible to gain more insight into the ongoing maturational processes in the brain. In this article, we present a review of the major building blocks of the pipeline toward performing quantitative analysis of in vivo MRI of the developing brain and its potential applications in clinical settings. The review focuses on T1- and T2-weighted modalities, and covers state of the art methodologies involved in each step of the pipeline, in particular, 3D volume reconstruction, spatio-temporal modeling of the developing brain, segmentation, quantification techniques, and clinical applications. Hum Brain Mapp 38:2772-2787, 2017. © 2017 Wiley Periodicals, Inc.